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Abstract. For any given partial order in a rf-dimensional euclidean 
space, under mild regularity assumptions, we show that the intersection 
of closed (generalized) intervals containing more than 1/2 of the probabil- 
ity mass, is a non-empty compact interval. This property is shared with 
common intervals on real line, where the intersection is the median set of 
the underlying probability distribution. So obtained multivariate medians 
with respect to a partial order, can be observed as special cases of centers 
of distribution in the sense of type D depth functions introduced by Y. 
Zuo and R. Serfling, Ann. Stat, 28 (2000), 461-482. We show that the 
halfspace depth function can be realized via compact convex sets, or, for 
example, closed balls, in place of halfspaces, and discuss structural prop- 
erties of halfspace and related depth functions and their centers. Among 
other things, we prove that, in general, the maximal guaranteed depth 
is dTT- ^ s an application of these results, we provide a Jensen's type 
inequality for functions of several variables, with medians in place of ex- 
pectations, which is an extension of the previous work by M. Merkle, Stat. 
Prob. Letters, 71 (2005), 277-281. 
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1 Introduction. 

To attain any median m of a real valued random variable X, we have to pass 
at least half of the population, coming from either side of the real axis, via 
the relations 

Prob(X <E (-00, m]) > p, Prob(X <= [m, +00)) > 1 - p, p = -. (1.1) 

The proportion | is the largest possible, in the sense that there does not 
exist a p > | such that for arbitrary distribution of X there exists m € R 
which satisfies We say that a median is the deepest point with respect 

to a given distribution, or a data set. Quantitatively, we may assign a e?epi/i 
to each point i£R, according to the value of a depth function 

D(x; P) = inf{P((-oo, x]), P{[x, +00))}, P(S) : = Prob(X £ 5), (1.2) 

from where we can also see that the function D attains its maximum 1/2 in 
the set of median points. 

The literature devoted to the problem of extension of these observations 
to higher dimensions contains a variety of different approaches - see [H] or 
[27] for a comprehensive bibliography. In a high dimensional data set it is 
desirable to select one point, or a set of points that would correspond to 
intuitive notions of "deepest point", "most central point", or "the center of 
a data set", and can serve as a (best) representative or a reference point of 
a distribution or a data set. 

The definition (|1.2I) of a depth function includes a notion of direction: we 
can approach a point x 6 R from either left or right. The notion of direction 
in R d is related to partial order. In this paper we show, among other things, 
that with respect to any partial order that satisfies mild regularity conditions, 
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there is a well defined median set, in the sense that the depth (to be defined 
in Section 3) of each point of that median set is at least 1/2. The median 
set is always compact, and can be obtained as an intersection of a certain 
family of sets. 

The median sets defined with respect to a given direction (i.e., a partial 
order) are not affine invariant. On the other hand, Tukey's median, or 
halfspace median (first introduced in [20], see also [2] or [27j). which can 
be defined as the set of maximal depth with respect to the depth function 
(commonly referred to as the halfspace depth) 

D(x;P) = inf {P(H) \ H: any halfspace that contains x}, (1.3) 

is affine invariant, but the maximal depth is not guaranteed to be 1/2. As 
a generalization of (|1.3|l . Zuo and Serfling in [27J offered a general "depth 
function of type D", which is defined as 

D(x;P,C) =inf{P(C) | x G C G C}, (1.4) 

where C is a given collection of closed sets. A similar concept was introduced 
in [18]. In this paper we observe the function (|1.4|) defined with respect to 
arbitrary class U of open sets in place of closed sets in C. This slight change 
enables a considerable reduction of conditions for validity of certain results, 
and yields a collection of interesting and enlightening examples. We prove 
several general results for a class U under two very mild conditions, and we 
show that for each such class, the set of deepest points can be obtained as 
the intersection of a family of sets. It turns out that median sets can be also 
obtained as points having the depth not less than 1/2, with a special choice 
of IA. In this paper, by a multidimensional median set we understand only 
the set of points with the depth not less than 1/2. It can happen that such a 
set is empty; in general case we use use the term "center of the distribution" 
for the set of deepest points. These two cases need to be distinguished, as 
the corresponding sets have different properties. 

We show that in general, with the type D depth in H d we can be certain 
to find only point(s) with D(x; P) > l/(d+ 1), and we show that this bound 
is the best possible, thus extending a result from [4] for the halfspace depth. 

Finally, we show that each depth function generated by a family U of 
complements of compact convex sets, can be defined in terms of a family 
of halfspaces, and we represent the halfspace center ("Tukey median") via 
intersection of level sets of depth functions defined with respect to partial 
orders. In the last section, we discuss an analogue of Jensen's inequality 
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for functions of several variables, with medians (or, generally, points in the 
center of distribution) in place of expectations. 

The results presented in this paper are fully general, and hold without 
any particular assumptions about the underlying distribution. 

For more details regarding Tukey's median see [3], [I] and [27]. The 
latter paper and [9] give wide-ranging discussion of depth functions in general 
with numerous examples and a summary of further researches based on the 
halfspace depth. 

In papers [TJ [8] the simplical depth function was proposed, primarily im- 
portant for its corresponding version of multivariate median; also, [8] high- 
lighted some features the (simplical) depth function should fulfill. 

Numerous other depth functions have been introduced in the literature 
- some of the most relevant are presented in [14], [10], [H], [6], [9], [274 
EH [29], [21], [23], [24], [26], [25] and references therein. There are methods 
and techniques developed especially for the data sets, see for example, pp. 
Robustness properties of deepest points based on halfspace depth in context 
of location statistics are studied in [2]. 

Other approaches in defining multivariate centers are given in [19] (many 
of them not related to depth functions), [13], [21], [5] and references therein; 
as can be seen, this concept is not at all unambiguous like in the univariate 
case. 

Notations. Throughout the paper, R denotes the set of real numbers, 
and R is the set R together with ±oo. The symbols H d and R denote 
corresponding d-dimensional euclidean spaces (Points in R are allowed to 
have ±oo as coordinates). In Section 2, and in the material of later sections 
related to intervals, the points in R with d > 1 will be denoted by bold 
letters x, y, . . . and their coordinates by Xi,yi, . . ., respectively We say that 
the set S € H d , d > 1 is closed if it is closed in euclidean topology. Hence, 
for d = 1, the intervals [a, +oo) or (— oo,a] are closed for any a € R; a 
similar remark holds for generalized intervals with d > 1. We will observe 
H d - valued random variables X, considering them as being measurable maps 
from some abstract probability space (O,^", Prob) to (R d , B d , P) . Here B d 
is the Borel sigma-field on H d and P is a probability measure induced on 
H d by X (the probability distribution of X). 

For a random variable X, Med X denotes any of its medians, and {Med X} 
denotes the set of all medians. In the same way, we may talk about medians 
of a probability distribution P. 
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2 Multivariate medians. 

We start with a characteristic property of univariate median set. Let X be 
a random variable with a probability distribution P and let J be any closed 
interval with P{J) > 1/2. We will show that J contains every median of 
X. Indeed, if m is a median of X and m ^ J, then one of the intervals 
(— oo,m] or [m, +oo) is disjoint with J, which is not possible, since the sum 
of probabilities in both cases is greater than 1. Therefore, the intersection 

n j 

J=[a,b]: P(J)>l/2 

is nonempty, and it contains the median set [u,v] of X. Now, observe that 
for J 2n _i = (-oo,v + ^n-i) } and J<2n = { u ~ n = 1,2, ... we have 

that P{J n ) > 1/2 and so 

{MedX} = [u,v}= p| J n d p| J, 

n=l J=[o,6]: P(J)>l/2 

which together with the previous part, shows that 

{MedX}= P J (2.1) 

J=[o,6]: P(J)>l/2 

The relation (|2.ip can be as well taken as a definition of the median 
set for a given distribution, and this definition can be extended in a mul- 
tidimensional environment if we choose one of many possible extensions of 
the concept of one-dimensional interval. Out of several ones that we may 
think of (convex sets, star-shaped sets, balls and other special convex sets), 
only intervals with respect to a partial order can do the work, to ascertain 
non-emptiness of the intersection at the right hand side of (12. ip . 

Let ^ be a partial order in R and let a, b be arbitrary points in R . 
We define a d-dimensional interval [a, b] as the set of points in R d that are 
between a and b: 

[a, b] = {x G R d | a ^ x ■< b] 

Note that the interval can be an empty set, or a singleton. For the 
sake of simplicity, we want all intervals to be topologically closed. The 
interval can be norm bounded or norm unbounded; it would be reasonable to 
expect intervals with finite "endpoints" to be norm bounded, hence compact. 
Further, we would expect that intervals can be "big" as we wish, to contain 
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any ball or any compact set. Finally, we expect that bounded (with respect 
to partial order) sets posses the least upper bound and greatest lower bound. 
To summarize, we assume the following three technical conditions: 

(11) Any interval [a, b] is topologically closed, and for any a,b G H d (i.e., 
with finite coordinates), the interval [a,b] is a compact set. 

(12) For any ball B C R d , there exist a, b G R d such that B C [a, b]. 

(13) For any set S which is bounded from above with a finite point, there 
exists a finite sup S. For any set S which is bounded from below with 
a finite point, there exists a finite inf S. 

Example 2.1. Let K be a closed convex cone in R rf , with vertex at origin, 
and suppose that there exists a closed hyperplane tt, such that n n K = 
(that is, K \ {0} is a subset of one of open halfspaces determined by tt). 
Define the relation H by x ^ y y — x G K . The interval is then 

[a, b] = {x | x - a G K A b - x G K} = (a + K) n (b - K). 

If the endpoints have some coordinates infinite, then the interval is either 
a + K (if b R d ) or b - K (if a £ K d ) or K d (if neither endpoint is in K d ). 

It is not difficult to show that ■< is a partial directed order, and that it 
satisfies conditions (II)— (13) . 

The simplest, coordinate- wise ordering, can be obtained with K chosen 
to be the orthant with Xj > 0, i = 1, . . . , d. Then 

x -< y Xi < yi, i = l,...,d. (2.2) 

For the sake of illustration, let us note that possible kinds of intervals 
with respect to the relation (12. 2|) include: 

[(ai,a 2 ), (61,62)], [(01, a 2 ), (61, +00)], [(01, a 2 ), (+00, 6 2 )], 

[(01,02), (+00, +00)], [(-00, -00), (61, 6 2 )], [(ai,-oo),(+oo,6 2 )], 

where 01,02,61,62 are real numbers. For infinite endpoints we use strict 
inequalities, for example the last interval above is the set of (x, y) G R 2 such 
that a\ < x < +00 and — 00 < y < 6 2 . The intervals may be empty; for 
example, the first listed interval is empty if ai > 61 or if a 2 > 6 2 . 

□ 

The following theorem extends the one-dimensional property discussed 
in the beginning of this section. 
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Theorem 2.1. Let < be a partial order in R such that conditions (I1)-(I3) 
hold. Let P be a probability measure on H d and let J be a family of intervals 
with respect to a partial order <, with the property that 

P{J) > -, for each J G J. (2.3) 

Then the intersection of all intervals from J is a non-empty compact interval. 

The compact interval claimed in the Theorem 12.11 can be, in analogy to 
(|2.ip . taken as a definition of the median induced by the partial order ■<: 

{MedX}^ p| J, (2.4) 

J=[a,b\: P x (J)>l/2 

where X is a random variable on H d and Px is its probability distribution. 
In what follows, we will omit the subscript if the underlying relation H is 
obvious. 

It is shown in Appendix (Lemma lA.2j) that, in the case of the coordinate- 
wise partial order, the characterization (|2.4p is equivalent to a similar char- 
acterization given in [12]. It turns out that, in this case, the median set 
is just the Cartesian product of coordinate-wise median sets, which is the 
result stated in the form of an example in |18j . 

Theorem 2.2. Let the partial order ^ in H d , d > 1, be defined by 112. 2]) . 
and let {Med X} be the median set of a random vector X € H d , defined with 
respect to the partial order ^. Then 

{MedX} = {MedXi} x {MedX 2 } x ••• x {MedX d } (2.5) 

As we already mentioned, for other classes of sets, the intersection in 
(|2.ip is in general empty. However, in the next section we will see that some 
other classes can also have a non-empty intersection, but then, instead of 
having the measure > 1/2, the sets will generally have to have a greater 
measure. 

3 Depth functions. 

We start with a collection of sets V and the collection U that contains com- 
plements of sets from V, i.e., U = {S c \ S £ V}. For each x € R d and any 
probability measure P on Borel sets of R d , define a depth function 



D(x;P,U) = mi{P(U) \x£U eW}. 



(3.1) 
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The role of V will be clear later in this section, when we give an alternative 
description of the depth function in terms of sets in V. 

If for some x, there does not exist any U G U that contains x, on the 
right hand side of (13.11) we have empty set, and then D(x;P,U) = +00. To 
avoid this, we assume that 

(Ci) for every x G R rf there is a U G U so that x G U. 

Further, a constant depth function does not serve any purpose; to avoid that 
situation, we may pose two additional conditions (C2) : 

(C' 2 ) D(x; P,U) > for at least one x G H d and 
(C%) lim D(x;P,U)=0 

»+oo 

The condition (C'2) was also singled out in [27], as a requirement for any 
reasonable depth function. 

Before proceeding further, let us see some examples. 

Example 3.1. 1° The simplest family U that satisfies (C\) contains only 
one set - the whole space R d . Here D(x;P,U) = 1 for all x; condition (C£) 
does not hold. In next three examples, the conditions (C 2 ) and (C'2) hold 
(see Corollary I A. II in Appendix). 

2° In R d , d > 2, let V be a family of all closed intervals [a, b] with 
respect to the partial order induced by a convex cone, as in Example 12.11 It 
is easy to see that for each point x G R d , there exists a closed interval V 
such that x G" V; hence, the condition (C\) is satisfied. A particular case 
of this example is the coordinate- wise partial ordering in R rf , which in R 2 
yields V G V to be rectangles with sides parallel to axes. 

3° Instead of intervals in previous examples, we can take V G V to be 
arbitrary convex and compact sets with a property that the collection V 
is closed under translations, and that sets V can be arbitrary "big" (for 
example, every ball in R d should be contained in some V G V). Because 
of compactness and the translation property, for each x G R^ there exists a 
V G V that does not contain x, and (C\) follows. 

4° Consider now the class V of all closed halfspaces. The sets U G U 
are then open halfspaces, and then the definition (13. ip of depth function 
formally differs from Tukey's halfspace depth function that requires closed 
halfspaces to be in U. However, since P(U) = limP(V n ), where V n D U are 
closed halfspaces with boundaries parallel to the boundary of U at euclidean 
distance 1/n, it follows that values of D coincide for these two cases. The 
condition (C\) is clearly satisfied. D 
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We are here interested chiefly in finding the set where the function D 
attains its global maximum, or, more generally, the sets of the form 

S a = S a (P,U) := {x G K d | D(x;P,U) > a}, (3.2) 

The next Lemma gives a way to find S a without evaluation of the depth 
function. 

Lemma 3.1. LetU be any collection of non-empty sets in H d , such that the 
condition (Ci) holds. Then, for any probability distribution P, 

S a (P,U)= fl V, (3.3) 

V£V,P(V)>l~a 

for any a G (0, 1] such that there exists a set U G IA with P(U) < a; otherwise 
S a = R^. 

It is instructive first to observe S a in d = 1, as in the next example. 

Example 3.2. Let X be a real random variable with the distribution P. 
Take V to be the family of all closed intervals in R, and U to be the family 
of their complements. Then, using similar arguments as in the proof of (12. 1|) 
at the beginning of Section 2, it can be derived that S a = [q a , Qi-a], where 
q a is the smallest quantile of X of order a, and Q\- a is the largest quantile 
of X of order 1 — a: 

q a = inf {t G R | Prob (X < t) > a} and 
Qi-a = sup{t G R | Prob (X >t)> a}. (3.4) 

For a = i, [gi,Qi] is the median interval. D 

z 2 2 

In the case when the family V is consisted of closed intervals with respect 
to a partial order that satisfies (II) (13) , it follows from Section 2 and Lemma 
13.11 that the set Si/ 2 is non-empty, i.e. the corresponding depth function has 
maximum which is > 1/2, regardless of distribution P. For other families of 
V, the guaranteed maximum is smaller. 

Example 3.3. Consider the halfspace depth, as in Example 4° of 13. 11 in R 2 , 
with the probability measure P which assigns mass 1/3 to points A(Q, 1), 
B{— 1,0) and C(l, 0) in the plane. Each point x in the closed triangle ABC 
has D(x) = |; points outside of the triangle have D(x) = 0. So, the function 
D reaches its maximum value |. 
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Let us now observe the same distribution, but with depth function defined 
with the family V of closed disks. The intersection of all closed disks V with 
P(V) > 2/3 is, in fact, the intersection of all disks that contain all three 
points A, B, C ', and that is the closed triangle ABC. For any e > 0, a disc 
V with P(V) > 2/3 — e may contain only two of points A,B,C, but then 
it is easy to see that the family of all such discs has the empty intersection. 
Therefore, S a is non-empty for a < 1/3, and again, the function D attains 
its maximum value 1/3 at the points of closed triangle ABC. 

If the depth function is defined in terms of rectangles with sides parallel 
to coordinate axes, then the maximum depth is 2/3 and it is attained at 
(0,0). This conclusion follows immediately from Theorem 12.21 EH 

If a m is the maximum value of D(x; P,U) for a given distribution P, the 
set S am , i.e., the set of deepest points with respect to P, is called the center 
of the distribution P, and will be denoted by C(P,U). 

In the next theorem, we discuss some properties of the center, in the case 
when sets in U are open. A similar result for the family U of closed sets was 
obtained in (23, Theorem 2.11], but under more restrictive assumptions. 

Theorem 3.1. Let V be a collection of closed subsets of H d , and let U be 

the collection of sets V c , V € V, such that the condition (Ci) holds. Then, 
for arbitrary probability measure P, the function x i— > D(x;P,U) is upper 
semicontinuos. Moreover, under conditions (C2), the set C(P,U) on which 
D reaches its maximum is equal to the minimal nonempty set S a , that is, 

c(p,u)= p| s a (p,u). 

a:S a ^<t) 

The set C(P,U) is a non-empty compact set and it has the following repre- 
sentation: 

C(P,U)= f] V, where a m = max xeRd D(x;P,U). (3.5) 

VdV,P{V)>l-a m 

4 Equivalence of depth functions. 

We already noticed that the depth functions with U being all open or all 
closed halfspaces, have the same value at every point. So, it is possible that 
two different classes of sets in place of U generate the same depth function. 
In the next theorem we give a sufficient condition for the equivalence of two 
depth functions. 
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Theorem 4.1. Let A and B be families of subsets ofH d . Suppose that the 
condition (Ci) holds for at least one of these families, and, in addition, the 
following condition (E): 

(£") For each A G A, A = \J B&B BcA B, and 

(E") For each B G B, there exists at most countable collection of sets Ai E 
A, such that Ai D A 2 5 . . . and B = f] i A i . 

Then the condition (Ci) holds for both A and B and depth function with 
respect to both families are equal, with any probability distribution P : 

D(x; P, A) = mi{P{A) | x G A G A} = inf {P(B) \ x G B G B} = D(x; P, B) 

An important application of Theorem l4.1l is to establish the equivalence of 
depth functions defined by a family of open sets A € A and their topological 
closures A G B. In this setup, we note that (E) holds in cases when A is 
invariant with respect to translations, and consists of (i) open halfspaces or 
(ii) complements of all closed intervals with any convex cone partial order, as 
in example I2.1L Another application of Theorem 14, II will be given in Theorem 
ET51 

5 Convex sets and halfspaces. 

Suppose that a family U contains a sequence of nested sets U n that intersect 
at one point x G R d . Then D(x; P,U) = P(x) for any P, which is undesirable 
property. Therefore U should not contain sets that shrink to a point. A way 
to avoid that is to choose sets in U to be unbounded, or to choose sets in V 
to be bounded. 

Further, it is natural to have a convex center of distribution, which is 
achieved (via Theorem 13.1(1 if sets in V are convex. With non-convex sets in 
V, and with a discrete distribution P, we can again have that D(x;P,U) = 
P(x) for every x G R rf , as shown in the next example. 

Example 5.1. In R 2 , let K be the lower half of the first quadrant, bounded 
by halnines y = and y = x. Let us consider the family U of sets that can be 
obtained by arbitrary rotations and translations of K. Let V be the family 
of complements of sets in U: sets in V G V are non-convex. 

Suppose that a distribution P is concentrated in six points ^^(±1,0), 
X3 i 4(±2, 0), ^5^(0, ±1) (as in the Counterexample 2 in [27]). Then for each 
point x G R d , there is a set U G U that does not contain any point of the 
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support different from x; hence the depth of each point is P({x}). With 
a specific discrete distribution P, the center is the point with the greatest 
probability mass. If P is uniform across the Xj, i = 1,...,6, then the 
center is the discrete set {X\, . . . ,Xq}. This is in a sharp contrast with the 
halfspace depth function, which in this case yields the single point center at 
(0,0), with the maximum depth \. Q 

A prototype of depth functions that we discuss in this section is a depth 
function defined with respect to families U of complements of compact convex 
sets. In the light of the arguments given above, these requirements are 
natural and they are not too restrictive (see also Lemma l5~Tl) . Although it 
may look that by these requirements we are excluding the halfspace depth 
from consideration, it is not so, as we will see after the Theorem 15.21 

Prom the material of Section 2, it follows that the depth function based on 
a family V of intervals, attains the maximal value of at least 1/2, regardless 
of the dimension d. In general, the maximum depth with a family V of 
convex sets, can not be smaller than ^j-j-. This conclusion follows from the 
next theorem, which is an extension of results in [4] and [16J. 

Theorem 5.1. Let P be any probability measure on Borel sets of~R d . Let 

V be any family of closed convex sets in H d , and let IA be the family of 

their complements. Assume that conditions (Ci) and (C^) hold. Then the 

condition (C' 2 ) also holds, and there exists a point x G H d with D(x; P,IA) — 
1 

d+l ■ 

The lower bound for D in Theorem 15. H is the greatest generally possible. 
As the next example shows, for the halfspace depth, in any dimension d > 1, 
there exist a probability measure P such that D(x;P,U) < ^ for all x G 
R d . 

Example 5.2. This is an extension of the example 13.31 Let A%, . . . , Ad+i be 
points in H d such that they do not belong to the same hyperplane (i.e. to any 
affine subspace of dimension less than d), and suppose that P({Ai}) = 
for each i = 1, 2, . . . , d + 1. Let S be a closed d-dimensional simplex with 
vertices at A%, . . . , Ad+i, and let x G S. If x is a vertex of S, then there exists 
a closed halfspace H such that x G H and other vertices do not belong to H; 
then D(x) = P(H) = l/(d+l). Otherwise, let S x be a d-dimensional simplex 
with vertices in x and d points among A±,..., A^+i that make together an 
affinely independent set. Then for S x and the remaining vertex, say Ai, there 
exists a separating hyperplane it such that irnS x = {x} and A\ ir (see [EJ 
Section 11]). Let H be a halfspace with boundary w, that contains A\. Then 
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also D(x) = P{H) = l/(d+l). So, all points x G S have D(x) = l/(d+ 1). 
Points x outside of 5 have -D(x) = 0, which is easy to see. So, the maximal 
depth in this example is exactly l/{d + l). □ 

In fact, if we have a family of compact convex sets V that contain arbi- 
trary large sets (in the sense of the following lemma), then it is sufficient to 
assume only condition (Ci), and then (C2) will automatically hold. A nat- 
ural way to choose V would be then, to choose one compact convex shape, 
and allow translations (and, possibly, rotations, if we want an affine invariant 
depth). 

Lemma 5.1. Let V be a family of compact convex sets in R d ; and let IA be 
the family of complements of sets in V , such that the condition (C\) holds. 
Suppose that for every closed ball B G R d there exist a set V G V , such 
that B C V. Then the family U and the depth function D(- ;P,U) satisfy 
conditions (C 2 ) and (C^), with any probability measure P on R rf . 

In the next theorem, we use the fact that every closed convex set can 
be represented as an intersection of closed halfspaces (see, for example, [El 
Theorem 11.5]). This representation is not unique (and we do not need 
uniqueness neither in the statement nor in the proof); however, there is a 
unique minimal representation of a convex set as the intersection of all its 
tangent halfspaces [IU Theorem 18.8], which is an intuitive model for the 
representation (15. lh below. 

Theorem 5.2. LetV be a collection of closed convex sets andli the collection 
of complements of all sets in V. For each V G V , consider a representation 

V= p| H a , (5.1) 

aeA v 

where H a are closed subspaces and Ay is an index set. Let 

H v = {Hg + x I a G A v , x G R d } 

be the collection of closures of complements of halfspaces H a and their trans- 
lations. Further, let 

n=[jn v . 

vev 

If for any H G fi there exists at most countable collection of sets V{ G V, 
such that 

V x C V 2 C • • ■ and H=\J V i} (5.2) 
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then 

D(x;P,U) = D(x;P,H) = D(x;P,H), for every x G K d , 

o 

where TL is the family of open half spaces from 7i. 

As a corollary to Theorem l5.2l we can single out two important particular 
cases. Conditions (|5.ip and (|5.2|) in both cases can be easily proved. 

Corollary 5.1. a) Let V be the family of closed intervals with respect to the 
partial order defined with a convex cone K , as in the Section UJ Then for 
any probability distribution and any x G R d , 

D(x;P,U) = D{x;P,n), 

where U is the family of complements of sets in V and H is the family of all 
tangent halfspaces to K , and their translations. 

In particular, ifV is the family of intervals with respect to the coordinate- 
wise partial order, then the corresponding depth function is the same as the 
depth function generated by halfspaces with borders parallel to the coordinate 
hyperplanes. 

b) Let 7i be the family of all closed halfspaces, let Uf~ be the family of com- 
plements of all compact closed sets, and let U\, be the family of complements 
of closed balls in H d . Then 

D(x;P,H) = D(x;P,Uk) = D(x;P,U b ), 

That is, the Tukey halfspace depth can be realized via complements of 
closed convex sets or via complements of closed balls. 

The second part of Corollary 15.11 implies, via Lemma 13.11 that for the 
halfspace depth function D, we have 

S a = {x G K d | D(x) >a}= p| K = f] B, (5.3) 

K: P{K)>l-a B: P(B)>l-a 

where K are compact convex sets, and B are closed balls. The reduction to 
balls is of the obvious interest in applications, where we have to find deepest 
points of a high dimensional cloud of data. 
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6 Affine invariance and another representation of 
the halfspace center of distribution. 

A depth function D{x\PxM) m R d is sa id to be affine invariant, if 

D(Ax + b\PAx+bM) = D{x\PxM) for any probability measure P, (6.1) 

for any nonsingular dx d matrix A, any b G R d and x G R rf , where PAX+b is 
a probability distribution of a random variable AX + b, X being a random 
variable with the distribution Px- Prom the definition f)6.ip . it follows that 
one sufficient condition for affine invariance of D is the affine invariance of hi: 
If U EU, then AU + 6 6W, for all A and b. This condition is satisfied with 
the family hi of all halfspaces; hence the halfspace depth is affine invariant. 
Due to the fact that the same depth function can be generated by different 
families hi, this condition is not necessary, as the next example shows. 

Example 6.1. Let V be the family of all closed discs in R 2 , and let hi 
be the family of their complements. The family hi is not affine invariant, 
because the circles transform into ellipses, with a non-orthogonal matrix A. 
However, the family of all halfplanes Ti generates the same depth function as 
the family U, and so, the depth D(x;P,U) is equivalent to halfspace depth, 
hence, it is affine invariant. Q 

For depth functions that can be generated by a family of halfspaces, the 
conditions of affine invariance can be expressed via translation and rotations, 
as every halfspace in H d can be transformed into another one by one rotation 
and one translation. That is, for every two halfspaces Hi,H2 G R d , there 
exists an affine transformation x i— > Ax + b with A being an orthogonal 
matrix, such that H2 = AH\ + b. 

Consider one coordinate system in R rf , with the corresponding set J 
of coordinate-wise intervals. Any rotation p of the coordinate system will 
produce another family of intervals J p . According to Theorem 15.21 depth 
functions based on the family \J P J P (where the union goes through all possi- 
ble rotations) is equivalent to the halfspace depth function. More generally, 
we may observe any set of partial orders (where p belongs to some 

index set) that satisfy conditions (II )- (13) of Section 2 such that the cor- 
responding families of intervals J p (i.e., families U p of complements of sets 
from Jp) together generate the halfspace depth function. Let us call such 
set of partial orders complete. For a given probability distribution P, and a 
complete set of partial orders, let 

S Q , P = {x G R d I D(x; PMp) >a}= f] J; 

J&J P : P(J)>l-a 
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S a = {x G H d | D(x; P, H) > a}, 

where a < a m , and Ti is the family of all open halfspaces. Then by com- 
pleteness, we have that 

P Jej p : P(J)>l-a P 

For a = a m , (|6.2|) gives another representation of the center of a distribution, 
in terms of sets that are not affine invariant. If we take any finite subset of 
partial orders, p = 1, . . . , n, then we have 

C(P,H)C f]S amjP , (6.3) 
P =i 

which gives an upper bound for the center of distribution in terms of finitely 
many partial orders. 

Note that, in general, the sets S amtP are not centers of the distribution 
with respect to < p ; we proved in Section 2 that there exist median sets 
5i/2,p- In general, we have that a m < 1/2, and Si/2,p C S amiP . Median sets 
with respect to different partial orders may have empty intersection. For 
example, if the distribution is absolutely continuous, then every median set 
with respect to a coordinate-wise partial order is a singleton; clearly by a 
rotation of the coordinate system we may obtain different singletons. 



7 A version of Jensen's inequality. 

Let V be a family of closed sets, U the family of complements of sets from 
V and let D(x; P,U) be defined as in previous sections. Let C = C(P,U) be 
the center of a probability measure P in R d , with a m being the maximum 
of the depth function. Assume conditions (Ci) and (C2). 

For a random variable X with the distribution P, the points in the set 
C(P,U) can be thought of as a kind of mean values of X, in the same sense 
as univariate medians are being thought of. If / is a real valued function 
defined on R d , then the analogous mean value of f(X) are points in the 
closed interval [q a , n , Qi-a m ], where, by (13. 4|) . q am is the smallest quantile 
of f(X) of order a m , and Q\- am is the largest quantile of order 1 — a m . 
If a m = 1/2, we have the median interval of f(X), and the center C(P,U) 
becomes {MedX}. Let m G {MedX} and M G {Medf(X)}. With analogy 
to Jensen's inequality /(EX) < E f(X) for convex functions, we may expect 
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that f(m) < M for an appropriate class of functions /. Indeed, we prove 
a result of that kind, for the class of functions that are described in the 
following definition. The name C-function is taken from [12J, where it was 
used in a more particular context. 

Definition 7.1. A function / : H d h-> R will be called a C-function with 
respect to a given family V of closed subsets of H d , if oo,t]) 6 V or 

is empty set, for every t G R. 

Example 7.1. 1° If V is the family of all closed convex sets in R rf , then 
the class of corresponding C-functions is precisely the class of lower contin- 
uous quasi-convex functions, i.e., functions / that have the property that 
oo,i]) is a closed set for any t G R and 

f(Xx + (l-X)y) <max{/(x),/(y)}, AG [0,1], x,yeK d . 

This is easy to see, starting from the definition 17.11 In particular, every 
convex function on R d is a C-function with respect to the class of all convex 
sets. 

2° Let D{x) be a halfspace depth function. Then it follows from (13.31) 
that the sets S a are convex, which implies that the function x i— > 1 — D(x) 
is a C-function with respect to a family of all closed convex sets. 

3° A function / is a C-functions with respect to a family of closed intervals 
(with respect to some partial order), if and only if 

{x G K d | f(x) <t} = [a,b], for some a,b G K d ,d > 1. 

This condition is not satisfied for all convex functions. For example, in 
R 2 , with the coordinate-wise partial order the function defined by f{x,y) = 
x 2 + y 2 is convex, but the sets {(x,y) \ x 2 + y 2 < t} are not intervals. 
4° In R 2 , with coordinate- wise intervals, the function / defined by 

f(x,y) = max{|x - ai| - \x - &i|, \y - o 2 | - \y - b 2 \} 

is a C-function, where 0(0,1,02) and 6(61,62) are given points in R 2 . 

5° In general, assuming conditions (I1)-(I3), we may define the depth 
function D(x) with respect to the class U of complements of the given fam- 
ily of intervals. Since the intersection of closed intervals is again a closed 
interval, we see that here also the function x 1— > 1 — D(x) is a C-function. 

6° Note that, since we require sets in V to be closed, every C-function is 
lower semicontinuous. D 

The next two theorems are versions of Jensen's inequality. 
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Theorem 7.1. £ef V be a family of closed intervals with respect to a partial 
order in H d , such that conditions (I1)-(I3) are satisfied. Let {MedX} be 
the median set of a random variable X with respect to the chosen partial 
order, and let f be a C- function with respect to the family V . Then for every 
M G Med{/(X)}, there exists an m G {MedX}, such that 

f{m) < M. (7.1) 

In particular, if m or M are unique, then Ii7.1\) holds for any m, M . 

In general case the depth function does not necessarily reach the value 
of 1/2, and we have only a weaker result: 

Theorem 7.2. Let V be a family of closed subsets of Ti d , and let U be the 
family of their complements. Assume that conditions (C\) and (C2) hold 
with a given probability measure P, induced by a random variable X. Let 
a m be the maximum of the depth function D(x; P,U), which is achieved in 
all points of the center C(P,U) and let f be a C-function with respect to V . 
Then for every m G C(P,U) we have that 

f(m)<Qi- am , (7.2) 
where Qi- am ^ s ^ e largest quantile of order 1 — a m for f(X). 

To show that we can not claim anything better in a general case, consider 
the following example: 

Example 7.2. Let A,B,C be non-colinear points in the two dimensional 
plane, and let H be the collection of closed halfplanes. Let l(AB), l(AC),l(BC) 
be the lines determined by two indicated points. Let H\ be the closed half- 
space that does not contain the interior of the triangle ABC and has l(AB) 
for its boundary, and let H2 be its complement. Define a function / by 

f{x) = e -^MAB)) ilxeHl: /(a .) = e d(x,i(AB)) ifxe R ^ 

where ■) is euclidean distance. Then f(A) = 1, f(B) = 1 and f{C) > 1, 
and / is clearly a C-function with respect to the class TL. Now suppose that 
P assigns mass 1/3 to each of the points A,B,C. Then, by example 13.31 
we know that the center C(p,H) of this distribution is the set of points of 
the triangle ABC, with a m = 1/3. Hence, for m G C(P,H), f(m) takes 
all values in [1, /(C)]. On the other hand, quantiles of the order 2/3 are 
points in the closed interval [1,/(C)]; hence the most we can state is that 
f(m) < /(C), with /(C) being the largest quantile of order 2/3. 
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A APPENDIX: PROOFS AND AUXILIARY 

RESULTS 

In order to prove Theorem 12.11 we need the following lemma. 
Lemma A.l. Let H be a partial order in R d such that the conditions (II) 
and (13) hold. Let 

J = {J a \ J a = [a a ,b a ], a(£A} 

be a collection of closed intervals, where A is an index set. Assume that there 
is at least one a such that a a 6 R rf (i.e., have all coordinates finite) and at 
least one (3 such that bP € R rf . Suppose that J a D Jp ^ for all a, [3. Then 

(i) a a < b , for any a, (3 £ A; 

(ii) The intersection of all sets in J is a non-empty compact interval [a, b], 
with a,b eRf 

Proof. If intervals [a, b] and [c, d] have a common point x, then a < x ■< b 
and c < x < d\ hence a < d and c <b. This shows (i). Further, to show 
(ii), note that by assumptions and (i), the set {a a , a £ A} is bounded from 
above with a finite point, and so by (13), there exists a = sup Qg ^ a a . In an 
analogous way we conclude that there exists b = infg ey i b@ . By properties of 
the infimum and supremum, we have that a a H a ^ b H b a , for all a G A, 
so the interval [a,b] is non-empty; it is compact by assumption (II), and it 
is contained in all intervals of the family J . On the other hand, any point 
c that is common for all intervals J a must be an upper bound for {a a } 
and a lower bound for b a ; hence a < c < b, that is, c G [a, 6], and (ii) is 
proved. □ 

Proof of the Theorem I2.1L It is clear that any two intervals in J 
have a non-empty intersection; besides, by (12), at least one of the intervals 
has finite endpoints. Then the assertion follows by Lemma fA. II D 

Proof of the Theorem I2.2L To simplify notations, we give the proof 
for d = 2; the proof in a general case is analogous. We have the sequence of 
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relations 

{MedX}= f] [a,b] 

[a,b] Prob(Xe[a,b])>! 

H [ai,h] x f] [03,62] 

[a,b\. Prob(Xg[a,5])>| [a,b] Prob(X g[a,&])>± 

^ n t«i^i] >< n 

[ai,6i]: Prob(Xie[a 1 ,6i])>i [02,62]: Prob(X 2 g[a2,ft 2 ])> | 

= {MedXi} x {MedX 2 }, 

where we used the fact that X\ £ [a±, b\] whenever X £ [a, b]. On the other 
hand, if {MedXi} = [a, b] and {Med-X^} = [c,d], then we have that 

[a, b] x [c, d] = [a, +00) x R n (-00, b] x R n R x [c, +00) n R x (-00, d] 

and we note that all four two-dimensional intervals on the right hand side of 
the last identity, can be expressed as intersections of a sequence of intervals 
J n with Prob(X G J n ) > 1/2; for example, 

+00 

[a, +00) x R = P| [a — 1/n, +00) x R, 

and Prob(X £ [a — 1/n, +00) x R) > 1/2 because [a, b] is the median set for 
X\. From this we conclude that 

{MedXi} x {MedX 2 } D {MedX}, 

and the theorem is proved. D 
Another result related to the coordinate-wise partial order intervals is 
presented in the next lemma. For a given probability measure P, denote by 
J the class of all intervals J with the property that P (J) > 1/2. 

In [12] , the class X is defined as the family of all closed intervals I C R d 
(with respect to coordinate- wise partial order) with the following property: If 
J is any closed interval (with respect to the same partial order) that contains 
I as a proper subset, then J € J '. 

In the following lemma, we show that the intersection of all intervals in 
T coincides with the intersection of all intervals in the class J , i.e., with the 
median set, as it is defined in the present paper. The purpose of this result is 
to establish the equivalence between the definition of multivariate medians 
in the present work and in [12J, for the special case of coordinate- wise partial 
order, which is considered there. 
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Lemma A. 2. Let I and J be families of intervals as defined above. Then 
(i) Each interval I El can be represented as I = r)jeJ,JDlJ i 

(a) n IeI i = n Je jJ 

Proof. For JgI, let et S(I) = f]jeJ,JDi J - Clearly, / C S(I). To show 
that S(I) C /, take any x $ I. Since / is a closed interval, there is another 
closed interval J such that I C J C {x} c , where both inclusions are strict, 
and thus x ^ S(I). This ends the proof of (i). To show (ii), note that if 
J € J, then J G Z, so J C X. Hence, 

rv=>rv- 

Jej lei 
Conversely, by the part (i), we have that 

rv=n n '-n< 

lei I JeJ,JDi Jej' 
where J' C J ', and hence, we conclude that Oj^jl D ^- ^ 

Proof of the Lemma I3TT1 Evidently, x e if and only if D(x) < a, 
i.e., if and only if there exists a set U £W such that x € U and P(U) < a. 
Therefore, if there are U €U with P(U) < a, then 

S c a = \J U, and so, S a = f] U c , 

UeU,P(U)<a UeU,P(U)<a 

which is equivalent to the assertion that we wanted to prove. 

Proof of the Theorem 13. 1L Under (Ci) and if all sets in V are closed, 
the set S a is closed for every a, via (13. 3|) . and hence, the function D is upper 
semicontinuous. Under additional conditions (C2), we will show that there 
exists at least one a such that S a is a nonempty compact set. Indeed, by 
the assumption, there is x G H d so that D(x) = Qo > 0. On the other hand, 
by assumption of convergence of D(x) to zero as ||x|| — > +00, there exists an 
R > so that D[x) < ao for ||x|| > R. Therefore, the set S ao is nonempty 
and norm bounded, and being closed, it is compact. Then all sets S a with 
a > ao are compact, because S a C S ao for a > oq. The intersection of 
non-empty compact nested sets S a is a non-empty compact set, and it is 
clearly the set on which D reaches its maximum. Q 
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Proof of Theorem 14.11 Suppose that the stated conditions hold. If 
(Ci) holds for A, then (E?) implies that it holds for B. If (Ci) holds for B, 
then it clearly holds for .A by (E"). 

Let x G R rf be fixed. Then by (E 1 ), for each i£i that contains x, there 
exists a G B such that x G P^ C A, and, consequently, P(A) > P(B^). 
Therefore, 

D(x; P, A) > inf {P{B A ) \ x G P>a £ B, A £ A} 

> M{P(B) | x G P € B} = D[x\ P, B) 

as the class of all Ba is a subset of the class of all B G B that may contain 
x. On the other hand, by (E"), for each e > and for each B G B that 
contains x, there exists As G .4, such that P(P) > P(Ab) — e. Then 

inf{P(P) | x G B G B} > inf{P(A B ) | x G A B , 4 B G A, B G B} - e 

> inf{P(A) |xG AeA}-E = %P,i)-E, 

and since e > is arbitrary, we conclude that 

D(x;P,B) =M{P(B) | x G S G B} > Z)(x;P,4), 

which ends the proof. D 
The next Lemma is technical, and we need it for the proof of Theorem 

EH 

Lemma A. 3. Let P be any probability measure on Borel sets of~R d . Let K 
be a compact set in R d and let A be a family of closed convex subsets of K , 
with P(A) > for every A G A. Then the intersection of all sets A £ A 
is a non-empty compact set. 

Proof. If P{Ai) > 1— e, i = 1, 2, . . ., then it is easy to prove by induction that 
P(Ai ■ ■ ■ A n ) > 1— ne for n > 2. Therefore, under given assumptions, for any 
d+1 sets A 1 ,...,A n eA,xt holds that P(Ai ■ ■ ■ A d+1 ) > l-(d+l)-^ = 0. 
Hence, every d + 1 sets of the family A have a non-empty intersection. By 
Helly's intersection theorem ( [TTl 12.12.]), every finite number of convex sets 
in A have a non-empty intersection. Since K is compact, then all sets in A 
have a non-empty intersection (see e.g. [22j Theorem 17.4]). The intersection 
is compact since all sets in A are compact. □ 

Proof of Theorem 15.11 Let 5 G (0, 1) be fixed. Assuming that 
(Ci) holds, we will first prove that every compact convex set K C H d with 
P(K) = 1 — 5 > contains a point x with D(x;P,U) > Indeed, let 
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e = ^| and suppose, contrary to the statement, that D(x;P,U) < e for 
every x G if, where K is a compact set with P(K) = 1 — S > 0. Then (by 
(Ci)), for every x £ K there exists &U X & U, such that P(U X ) < s. Clearly, 

(J £4 3 (A.i) 

Let U£ = V X . Then G V, and by [|A"lj) it follows that 

P| (Vi n if) = (A.2) 

Let us now define a new probability measure P* on R d , by 

P*{B) = P ^ B where 5 C R rf is a Borel set. 

l — o 

For each x G if , we have that P(V X ) > 1 — e, and 

- o~) 
d+1 ' 



p(y, n if) > P(K) + p{k) - i>\-£ — 8 



hence P*(Vi n if ) 

> d+T- Now by Lemma IAi3l we conclude that the family 
of sets V x nK have non-empty intersection, which contradicts (IA.2p . So, the 
statement about compact convex sets is proved. 

To prove the statement of the Theorem 15. 11 note that the statement that 
we already proved yields the condition (C' 2 ), and, with additional assumption 
(C2), Theorem 13.11 is applicable. By the first part of the proof, each of the 
sets 

1 - ± 

S n = {xe-R d \D(x;P,U)>j^-}, n = l,2,... 

is non-empty; then their intersection. 

+00 ^ 
P| S n = {x e R d I D(x;P,U) > j— -}, 



n=l 



is also non-empty, by Theorem 13.11 This ends the proof. D 
Proof of Lemma 15. 11 We first prove that (Cjf) holds. For a fixed 
e > 0, and a given probability measure P, let i?i_ e be a closed ball centered 
at origin, with P(£>i_ e ) > 1 — e. Then, by assumptions, there exists a set 
V G V such that i?i_ E C V. By compactness, there exists r > such that 
all points x G V satisfy ||x|| < r. Therefore, all points x with [|ar|| > r are 
in [/ = V c , and, since P(CT') = 1 — P(V) < e, we conclude that for a given 
e > there exists r > so that D(x;P,U) < e for all cc with \\x\\ > r, which 
proves (C'l). Then by Theorem EH the condition (C 2 ) also holds. □ 
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Corollary A.l. Conditions (C2) hold for examples 2° —4° m l3.il with any 
probability measure P. 

Proof. For examples 2° and 3° in 13.11 it is straightforward to check that 
the assumptions of Lemma I5~T1 are satisfied; hence both conditions in (C2) 
hold. For the halfspace depth in Example 4°, we may apply Theorem 15.21 
to conclude that the halfspace depth function is the same as the one based 
on the family of all compact convex sets, which is the example 3°. □ 

o o 

Proof of Theorem 15.21 Let H be an open halfspace from %, and let 

o 

H be its closure. Given any x £H, there exists a closed halfspace H x that 
can be obtained by translation of H in such a way that the border of H x 
contains x. Then H x & Ti and, clearly, 

H= (J H x , 

o 

which implies condition (E') of Theorem 14.11 with A =TC and B = TL. On the 
other hand, for any given closed halfspace H G TL, there exists a sequence of 
halfspaces Hi, obtained from H by translation, such that 

00 o 

HiDH 2 D--- sm&H = C\iHi, 
which is the condition (E"). Therefore, by Theorem 14.11 

D(x;P,H) = D(x;P,H). (A.3) 

o 

Now note that (|5.ip gives condition (E') for A = U and B =TL (by taking 
complements on both sides); then, as in the proof of Theorem 14.11 we find 
that 

D(x;P,U)>D{x;P,H), (A.4) 

for every x £ H d . In the same way, (15. 2|) gives condition (E") for A = U 
and B = TL, and so, again as in the proof of 14.11 

D{x;P,U) < D{x;P,H). (A.5) 

The statement of the theorem now follows from (IA.3jl . (|A.4jl and (IA.5j) . D 
Proof of Theorem 17.21 Let Q = Qi- Qm . Then for every e > 0, 
Prob (f(X) < Q + e) > 1 — a m , and, therefore, the set 

V e = f-\(-oo,Q + e]) 
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contains the center C{P,U). This implies that 

f(m) < Q + e, for every m £ C(P,U) and every e > 0. 

Letting here e -> 0, we get □ 
Proof of Theorem 17.11 From Sections 2 and 3, we know that, in 
this case, the depth function reaches its maximum at 1/2; hence, for a given 
distribution P, and the corresponding random variable X, we have that 
C{P,U) = {MedX}, where the median set is taken with respect to the 
given partial order <, and {MedX} = [a ,b ] for some a ,b G R d . 

Then, by Theorem 1731 f(m) < Qi/ 2 , for any m G {MedX}. If, besides 
Qi/2, any other median M of f(X) exists, then we have that P(f(X) < 
M) = 1/2, hence the set V M = {x \ f(x) < M} has the probability P(V M ) = 
1/2. Therefore, Vm = [a, b] has a non empty intersection with any interval 
V a = [a a ,b a ] withP(T/ a ) > ±. Then, as in the proof of Lemma lA.ll it follows 
that a a <b and a <b a for all a, which implies, via relations ao = sup a a a 
and &o = fofa b a , that 

ao ^ & and a ■< bo, 

hence, [a, b] n [ao,&o] = [ a o ; ^o] / 0. Then the inequality (|7.ip holds with 
any m G [ao, bo]. D 
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